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Abstract (J Korean Assoc Oral Maxillofac Surg 2014;40:61-67) 

Objectives: The present study was conducted to determine the reproducibility of peri-implant tissue assessment using the new implant success index 
(ISI) in comparison with the Misch classification. 

Materials and Methods: In this descriptive study, 22 cases of peri-implant soft tissue with different conditions were selected, and color slides were 
prepared from them. The slides were shown to periodontists, maxillofacial surgeons, prosthodontists and general dentists, and these professionals were 
asked to score the images according to the Misch classification and ISI. The intra- and inter-observer reproducibility scores of the viewers were as- 
sessed and reported using kappa and weighted kappa (WK) tests. 

Results: Inter-observer reproducibility of the ISI technique between the prosthodontists-periodontists (WK=0.85), prosthodontists-maxillofacial sur- 
geons (WK=0.86) and periodontists-maxillofacial surgeons (WK=0.9) was better than that between general dentists and other specialists. In the two 
groups of general dentists and maxillofacial surgeons, ISI was more reproducible than the Misch classification system (WK=0.99 versus WK non- 
calculable, WK=1 and WK=0.86). The intra-observer reproducibility of both methods was equally excellent among periodontists (WK=1). For prosth- 
odontists, the WK was not calculable via any of the methods. 

Conclusion: The intra-observer reproducibility of both the ISI and Misch classification techniques depends on the specially and expertise of the clini- 
cian. Although ISI has more classes, it also has higher reproducibility than simpler classifications due to its ability to provide more detail. 
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I. Introduction 

At present, the use of dental implants as optimal substitutes 
for lost teeth in oral rehabilitation is increasing 1 . More than 
one million implants are placed annually 2 . Osseointegrated 
implants have a high success rate. Clinical research has esti- 
mated the 5-year success rate of dental implants to be 95%- 
99% 35 . Despite their success, dental implants are susceptible 
to complications that can lead to failure 6 . Thus, it is necessary 
to recognize problems and influential factors of peri-implant 
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disease. Implant therapy, like other surgical procedures, can 
have complications, such as bone loss, pocket formation, pus, 
exudation, mobility, sensitivity to percussion, peri-implant 
pain and bleeding, which can lead to implant failure 7 ' 8 . Based 
on the severity of tissue involvement, peri-implant diseases 
are classified into two main groups: peri-implantitis and peri- 
implant mucositis 9 . 

The prevalence of peri-implant mucositis and peri-im- 
plantitis has been reported to be 8%-44% and 0.14%-4%, 
respectively. Mucositis refers to reversible inflammation of 
the peri-implant soft tissue, and peri-implantitis represents ir- 
reversible progressive peri-implant bone loss along with soft 
tissue inflammation 10 ' 11 . Generally, peri-implantitis develops 
at the coronal sites of an implant after osseointegration dur- 
ing the loading phase. At the final stage of the disease, bone 
loss involves almost all the implant surface, and the implant 
becomes mobile 12 . It is difficult to manage these lesions, 
which eventually lead to implant loss 10 ' 13 . The etiology of 
peri-implant diseases is usually multi-factorial, but bacterial 
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infection and excessive biomechanical forces are reported as 
the major causes. Although dental implant treatment usually 
has an excellent prognosis, more recent studies on long-term 
success show a higher prevalence for peri-implantitis 14 . In the 
Sixth European Workshop on Periodontology, the prevalence 
of peri-implantitis was reported to be 28%-56% (12%-40% 
of the implant sites) 15 . In the past, peri-implant tissue status 
was assessed using various criteria 16 . Researchers developed 
their own specific criteria in their studies as their standard ref- 
erence for the assessment of peri-implant tissues. This non- 
standardized process created problems for comparing the re- 
sults of different studies in the diagnostic or treatment phase. 
The Misch classification is a system that has been previously 
used in numerous studies 17 . In this classification, assessment 
of peri-implant tissue status is done using a combination of 
qualitative and quantitative criteria to differentiate between 
4 classes. In the implant success index (ISI) classification, 
which was designed by Kadkhodazadeh and Amid 18 in 2012, 
peri-implant tissue status is given a score from 1 to 9 based 
upon quantitative criteria. The present study sought to assess 
the reproducibility of this new peri-implantitis assessment 
technique compared to the Misch system. 

II. Materials and Methods 

This descriptive study was conducted at Shahid Beheshti 
Dental School (Tehran, Iran) from June 2012 to February 
2013. Twenty-two cases of peri-implant complications in 
different stages were selected to cover different types of mu- 
cositis and peri-implantitis. The samples were chosen by five 
periodontists with a minimum of 7 years of experience in 
implant dentistry. They were provided with radiographs and 



photographs of the implants as well as data regarding probing 
depth, bleeding on probing, pus formation and bone loss in 
patients. The exact values of probing depth (mm), bleeding 
(+/-), bone loss (mm) and pus (+/-) were written below the 
figures to reduce the risk of information and selection bias. 
The slides included clinical photographs, clinical data (prob- 
ing depth, bleeding, bone loss and pus) and radiographic 
views prepared in similar sizes. The slides were printed in 
color and delivered to 10 periodontists, 10 maxillofacial sur- 
geons and 10 prosthodontists as well as 30 general dentists 
who had been practicing dental implant therapy for at least 
five years. (Fig. 1) The aforementioned groups were asked to 
make a diagnosis using the provided data and to classify the 
cases (images) based on the Misch classification and ISI sys- 
tems. (Tables 1, 2) Both the Misch and ISI systems had been 
previously explained to participants by one of the clinicians 
who was not involved in the study, and they were also pro- 
vided with a copy of a related article. Specialists and general 
dentists scored the peri-implant status based on the descrip- 
tions for both classification systems. This process was re- 
peated 4 weeks later and the reproducibility of the results was 
compared. Statistical analysis was performed using PASW 
Statistics 18.0 software (IBM Co., Armonk, NY, USA). 
Based on the study design and qualitative results of both the 
Misch and ISI systems for outcome estimation, intra-observer 
and inter-observer reproducibility were calculated and com- 
pared using kappa and weighted kappa (WK) tests (kappa=l: 
complete agreement, kappa=0: no agreement). 

III. Results 

Regardless of the field of specialty, the inter-observer re- 



PPD:2mm SL: + 
BOP: - BL: 2 mm Implant length: 12 mm 





. 1 



Fig. 1. A slide with clinical and radio- 
graphic views and required clinical data 
representing a case of class I Misch and 
class IV implant success index (PPD: 
probing pocket depth, SL: soft tissue 
level, BOP: bleeding on probing, BL: 
bone loss). 
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Table 1. Implant success index (ISI) 



Score 


SL 


HL 


Clinical finding 


ISI I 


SL+, PPD <4 mm, BOP- 


HL+ 


Clinically healthy 


ISI II 


SL+, PPD < 4 mm, BOP+ 


HL+ 


Soft tissue inflammation 


TQT TTT 
lol 111 


rrJJ >4 mm, DKJr+ 


HL+ 


Deep soft tissue pocket 


ISI IV 


SL+ 


HL-, RBL < 2 mm ( < 20%) 


Initiation of hard tissue breakdown 


ISI V 


SL- 


HL-, RBL < 2 mm ( < 20%) 


Hard tissue breakdown plus 








Soft tissue recession 


ISI VI 


SL+ 


HL-, RBL: 2-4 mm (<40%) 


Notable hard tissue breakdown 


ISI VII 


SL- 


HL-, RBL: 2-4 mm (<40%) 


Notable hard tissue breakdown 








Plus soft tissue recession 


ISI VIII 




RBL >40% 


Severe bone loss 


ISI IX 




Clinical mobility 


Clinical failure 



(SL: soft tissue level, HL: hard tissue level, PPD: probing pocket depth, BOP: bleeding on probing, RBL: radiographic bone loss detected via long 
cone parallel peri-apical technique, +: tissue level located at or coronal to the reference line, -: level apical to the reference line) 
If the peri-apical area of implants has a bone loss/radiolucent view (retrograde peri-implantitis), it is identified by placing the letter R (e.g., ISI IR, 
ISI IIR, ISI IIIR, etc.). 
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Table 2. Misch classification 



Group 



Management 



Clinical condition 



III 



IV 



Normal maintenance 



Reduction of stress 

Shorter intervals between dental hygiene appointments 

Gingivoplasty 

Yearly radiographs 

Reduction of stress 

Drug therapy (antibiotics, chlorhexidine) 
Surgical reentry and revision 
Change in prosthesis or implants 



Removal of implants 



No pain or tenderness upon function 
0 mobility 

<2 mm radiographic bone loss from initial surgery 
Probing depth <5 mm 
No exudate history 
No pain 
0 mobility 

2 to 4 mm radiographic bone loss 
Probing depth 5 to 7 mm 
No exudate history 
No pain upon function 
0 mobility 

Radiographic bone loss >4 mm 
Probing depth >7 mm 
May have history of exudate 
Any of the following: 
Pain upon function 
Mobility 

Radiographic bone loss >l/2 the length of the implant 
Uncontrolled exudate 
No longer in mouth 



Group I: success (optimum health), Group II: survival (satisfactory health), Group III: survival (compromised health), Group IV: failure (clinical or 
absolute failure). 
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producibility of the ISI method was more acceptable than that 
for the Misch classification. When the observer's specialty 
was considered, the inter-observer reproducibility of the ISI 
system between the prosthodontists-periodontists (WK=0.85), 
prosthodontists-maxillofacial surgeons (WK=0.86) and perio- 
dontists-maxillofacial surgeons (WK=0.9) was better than the 
inter-observer reproducibility between the general dentists 
and other specialists. (Table 3) 
In the two groups of general dentists and maxillofacial sur- 



geons, the ISI system was more reproducible than the Misch 
system (WK=0.99 versus WK not calculable, WK=1 and 
WK=0.86). Among periodontists, the intra-observer repro- 
ducibility of both methods was equally excellent (WK=1). 
In the prosthodontists group, the WK was not calculable in 
either method. Thus, we may conclude that the intra-observer 
reproducibility in both the ISI and Misch systems depends on 
the specialty, expertise and skills of the clinicians. (Table 4) 
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Table 3. The results of the comparison of inter-observer reproducibility 

ISI Misch 



Group 


Kappa value 


P-value 


Weighted kappa 


Kappa value 


P-value 


Weighted kappa 


Dentist-dentist 


0.61 


0.001 


0.69 


0.56 


0.001 


0.62 


Dentist-periodontist 


0.56 


0.05 


0.63 


0.48 


0.01 


0.55 


Dentist-prosthodontist 


0.59 


0.05 


0.68 


0.51 


0.001 


0.59 


Dentist-maxillofacial surgeon 


0.51 


0.05 


0.75 


0.46 


0.001 


0.60 


Periodontist-periodontist 


0.79 


0.001 


0.87 


0.73 


0.001 


0.81 


Periodontist-prosthodontist 


0.53 


0.001 


0.85 


0.65 


0.001 


0.76 


Periodontist-maxillofacial surgeon 


0.44 


0.001 


0.90 


0.41 


0.001 


0.83 


Prosthodontist-prosthodontist 


0.63 


0.001 


0.75 


0.57 


0.001 


0.65 


Prosthodontist-maxillofacial surgeon 


0.58 


0.001 


0.86 


0.45 


0.01 


0.69 


Maxillofacial surgeon-maxillofacial surgeon 


0.89 


0.001 


0.95 


0.78 


0.01 


0.84 



(ISI: implant success index) 
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Table 4. The results of the comparison of intra-observer reproducibility 



Group 




ISI 






Misch 




Kappa value 


P-value 


Weighted kappa 


Kappa value 


P-value 


Weighted kappa 


Dentist 


0.89 


0.001 


0.99 


0.75 


0.001 


0.83 


Periodontist 


1.00 


0.001 


1.00 


1.00 


0.001 


1.00 


Prosthodontist 


0.82 


0.001 


0.91 


0.78 


0.001 


0.84 


Maxillofacial surgeon 


1.00 


0.001 


1.00 


0.80 


0.001 


0.86 



(ISI: implant success index) 
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IV. Discussion 

Previous studies have suggested some criteria for the as- 
sessment of implant success. The Misch classification for 
dental implant success has had the highest acceptance among 
the suggested systems 19 . This classification is based on the 
clinical examination of implants, and it can assist in implant 
status assessment in terms of health or disease. From a di- 
agnostic point of view, critics believe that the Misch clas- 
sification has some shortcomings since it does not provide 
the clinician with any information on the extensiveness or 
severity of the disease. This system also suffers from other 
drawbacks; for instance, the disease stage (mucositis or peri- 
implantitis) is not included in this classification. 

There is an important point to note in statistical analyses of 
studies like this one. We used three different approaches to 
design a proper study for comparing the efficacy of the clas- 
sification methods: intra-observer, inter-observer and inter- 
method reproducibility. The latter can be used only to com- 
pare classifications that have similar categories. As the Misch 
and ISI systems have different items, we assessed their intra- 
observer and inter-observer reproducibility. The sample size 
in these studies refers to cases rather than test participants. 



We selected 22 cases for the final analysis . 

A new classification system for the success assessment 
of dental implants is needed, and its validity and reliability 
should be confirmed in the clinical setting; it will also need 
to gain global acceptance. The ISI was designed based on the 
following criteria: bleeding on probing, probing pocket depth, 
radiographic bone loss and loss of function (mobility). Our 
study compared the reproducibility of a new peri-implantitis 
assessment system (ISI) with the Misch system. Our results 
revealed that overall, regardless of the specialty of the clini- 
cians, inter-observer reproducibility of the ISI system was 
more acceptable than that of the Misch system. With regard 
to clinician specialty, it was noted that the inter-observer re- 
producibility of the ISI method between the prosthodontists- 
periodontists (WK=0.85), prosthodontists-maxillofacial sur- 
geons (WK=0.86) and periodontists-maxillofacial surgeons 
(WK=0.9) was better than the inter-observer reproducibility 
between dentists and other specialists. This issue may be at- 
tributed to the inability of general dentists to accurately as- 
sess the criteria. 

For the calculation of Kappa as the reliability (reproducibili- 
ty) index, the classification method (Misch or ISI) should have 
an equal number of intra- and inter-observer categories. Thus, 
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even if only one category is lost due to the lack of reporting 
by an observer, the kappa and WK cannot be calculated. 

Additionally, in the two groups of general dentists and 
maxillofacial surgeons, the ISI system was more reproducible 
than the Misch system (WK=0.99 versus WK not calculable, 
WK=1 and WK=0.86, respectively). Among periodontists, 
the intra-observer reproducibility of both systems was equal- 
ly excellent (WK=1). For prosthodontists, the WK was not 
calculable in either system. Thus, we may conclude that the 
intra-observer reproducibility in both Misch and ISI depends 
on the specialty, expertise and skills of clinicians. Determina- 
tion of the level of significance was not indicated when we 
calculated the WK (rather than the kappa) for data analysis. 
Thus, a higher WK coefficient directly represented higher re- 
producibility. 

It appears that the high reproducibility of the ISI system 
was due to it having more details in comparison to the Misch 
system; the ISI has 9 categories versus 4 in the Misch system. 
Generally, periodontists and oral surgeons have been in- 
volved in evaluating implants placed in hard tissue. However, 
many prosthodontists are more concerned with the biome- 
chanical complications associated with the supra structure. 
Thus, they are not as familiar with implant success criteria in 
comparison to the other two groups. 

Only one previous study is available on the ISI system. In 
that study, researchers evaluated and compared the accept- 
ability of this new system for the success of dental implants 
with the Misch classification and showed significant differ- 
ences between the two in terms of primary diagnosis, efficacy 
for follow-up examinations, reproducibility, design and lack 
of overestimation based on quantitative variables; the mean 
scores of ISI were significantly higher than those of Misch 21 . 

In 1997, Murphy 22 determined 4 characteristics required for 
a classification system for implant success: usefulness, com- 
prehensiveness, relevance and disjointedness (one participant 
cannot be classified into two groups) and simplicity. The ISI 
possesses all these characteristics and eliminates the need for 
further diagnostic workup in the most comprehensive way 
possible. It has an easy application for estimation of the pres- 
ence or absence of comprehensiveness, as it is not possible 
to group one patient into more than one category. Using this 
classification system, the clinician can observe and record the 
presence or absence of the respective factors. Undoubtedly, 
the ISI system is not as simple as the Misch classification 
system, but it has greater clarity due to its use of 9 criteria 
versus the 4 in the Misch system. 

In the ISI, both the extensiveness and the severity of dis- 



ease are addressed. The degree of disease in this system in 
terms of extensiveness and the results of clinical examina- 
tions can be classified as mild, moderate or severe. ISI can 
therefore be used for the determination of the outcome of 
different implant treatments. Differentiation of the prevalence 
of peri-implantitis and the number of required treatments in- 
dicate over-estimation of the prevalence of peri-implantitis. 
Over-estimation suggests that the disease has a prevalence 
higher than the actual rate. There is no doubt that the implant 
success classification should be able to estimate the actual 
incidence of the disease and its severity to reduce the risk of 
excess treatment and associated costs. 

The ability for early diagnosis of disease is an important 
characteristic for a diagnostic system and helps reduce the 
prevalence of disease. However, the number of diagnostic 
systems capable of early diagnosis of disease is limited, and 
those that are available have a low efficacy with limited clini- 
cal applications. In general, early diagnosis of peri-implantitis 
by the clinician can have significant effects on the treatment 
outcome and the economic burden of disease. Considering 
the reproducibility of the ISI, this system is fully capable of 
fulfilling this criterion. The maintenance phase is of special 
significance. Recording some of the patient-related factors 
before patient registry for implant is necessary. Available 
clinical and radiographic data should be routinely collected 
after implant loading to obtain a baseline for the diagnosis 
of peri-implantitis during the maintenance phase of patients. 
The results of pocket probing, mucosal margin position and 
radiographic margins of the proximal bone should also be 
recorded. Maintenance and treatment of peri-implantitis must 
be evidence-based 23 . Furthermore, the ISI system has to be 
employed for primary assessment in implant therapy and 
should also be used in the maintenance phase. The efficacy of 
this system for determining the outcome of particular treat- 
ments by the allocation of pre- and post-treatment scores has 
been confirmed 21 . 

The ISI system has a quantitative base for estimation of 
the implant success rate. This system is distinctively differ- 
ent from the qualitative systems used to assess and classify 
treatment success based on patient comfort and satisfaction. 
Comparison of these systems based on their flexibility re- 
vealed that the ISI had greater flexibility for different implant 
systems in comparison to the Misch classification. Addition- 
ally, the high reproducibility of the ISI system is associated 
with its detail orientation. 

One limitation of our present study was the lack of re- 
sponse of participants to some of the questions, which meant 
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that the kappa and WK could not be calculated in some cases. 
In all diagnostic and classification systems, every question 
needs to be answered. As the ISI system has only been re- 
cently introduced, further studies with larger sample sizes 
will be required for ISI evaluation. The role of inflammatory 
biomarkers at different levels, the effects of time and differ- 
ent treatment protocols will need to be investigated in pro- 
spective studies as well. With these methods, the applicability 
of this system in daily clinical practice will be determined. 

Long-term studies on dental implants should be carried out 
according to the specific conditions accepted by scientific or- 
ganizations. Some of these principles emphasize that studies 
should be conducted on an adequate number of patients and 
treatment success or failure criteria should be better defined. 
Furthermore, failed implants must be analyzed in these stud- 
ies, and the duration of assessment should be 2-5 years 24 . The 
critical period for implant survival usually starts from im- 
plant placement and continues to one year after the exertion 
of occlusal forces (loading). Thus, after the completion of the 
first year, the clinicians can, to a great extent, decide on the 
success or failure of the implant 24 . In general, differences be- 
tween the results of various studies regarding implant success 
and peri-implant hard and soft tissue status can be attributed 
to factors such as the type of implants used, the surgeon's ex- 
perience and skills, the number of understudy samples (sam- 
ple size), oral hygiene status, number of follow-up sessions, 
the maintenance phase, duration of implant service, type of 
bone and bone grafts and criteria for implant assessment. 

V. Conclusion 

Although the Misch classification has 4 and the ISI system 
has 9 categories, it appears that the ISI system has higher 
reproducibility than the Misch system due to its greater atten- 
tion to detail. Further studies are required to assess the valid- 
ity of changes in the ISI score at different loading times and 
treatment procedures for failing implants. 
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